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FIELD OF THE INVENTION 

5 

The present invention relates generally to tools that automatically verify, using static 
checking techniques, the correctness of a computer program with respect to predefined 
criteria, and particularly to a tool that derives verification conditions that are annotated in a 
way that enables the tool to indicate a specific sequence of program instructions associated 
10 with potential programming errors detected by the tool. 

BACKGROUND OF THE INVENTION 

The purpose of a computer program verification system is to analyze a given computer 
15 program to determine whether or not it has certain desirable properties. Verification systems 
can also be used to analyze hardware components, formulae, algorithms, or, more generally, 
behavioral designs. 

A typical verification system works by generating a verification condition (VC) from a given 
20 behavioral design, and then processing the verification condition with a theorem prover. A 
verification condition is a logical formula that, ideally, is valid if and only if all possible 
behaviors of the design have the desirable properties under consideration. In practice, the 
verification condition generated may be only an approximation of the ideal verification 
condition. 
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The theorem prover should have the property that when it fails to generate a proof, it 
generates a number of potential counter-examples. The verification system then post- 
processes these counter-examples into warnings that the desirable properties may not hold. A 
warning may be spurious; that is, it may warn about something that is not a real error. 
5 Spurious warnings may arise when the theorem prover does not have enough information to 
generate a proof, when the prover is too weak a prover to automatically generate a proof, or 
when the verification condition produced is not quite the ideal one. 

A good verification system has the property that the warnings it produces are informative and 
10 easy for a designer to understand. If a warning message is informative and easy to 

understand, the designer can more easily determine whether a warning is real or spurious, and 
what its cause is. The designer can then act accordingly, correcting the design at the source 
of the problem, or ignoring the warning, possibly annotating the design so that the warning 
will be suppressed next time the verification system is run. 

15 

An informative warning message should, ideally, include a characterization of the possible 
defect (e.g., "array index of out bounds", "timing constraint not satisfied", "race condition", 
"deadlock", "failure to establish invariant") and a source location in the behavioral design 
where the verification system tried, but failed, to show the absence of the defect (e.g., "line 
20 218 of file 'ABC.source' "). However, because behavioral designs can include many 
behaviors that lead to a given source location, a warning message would be even more 
informative if it provided the sequence or set of behavioral aspects or steps that occur in the 
scenario of the reported defect, i.e., a program trace. Such behavioral aspects or steps are 
akin to an execution trace. 

25 

There is a class of authoring tools that performs verification functions and generates 
execution traces. These tools are called dynamic or run-time checkers, because they execute 
or simulate the execution of the behavioral design in question (i.e., the computer program) 
and output the active path at the time a possible defect is detected. Examples of such tools 
30 are PREfix (Intrinsa Corp., (1998)), which symbolically executes the given program, Testbed 
Studio, which uses an underlying model checker to perform an exhaustive, back-tracking 
symbolic simulation of a representation of a given design, and Eraser (Savage, S., et al, 
"Eraser: A Dynamic Data Race Detector for Multi -threaded Programs", ACM Transactions 
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on Computer Systems (TOCS), 15(4):391-41 1, November 1997. Also appeared in 
Proceedings of the Sixteenth ACM Symposium on Operating System Principles, October 5-8, 
1997, St. Malo, France, Operating System Review 31(5), ACM Press, 1997, ISBN 
0-89791-916-5, pp 27-37.), which works as the program is actually being executed. In 
5 general, run-time checkers entail a number of disadvantages: there may be an overhead to 
their use, i.e., the program to be checked may be very intensive of resources; some errors in 
the program may only manifest themselves under certain run-time conditions, such as certain 
values of the initial parameters; and some errors may be non-reproducible. 

10 By contrast, the present invention falls within a class of program verifiers known as static 
checkers. Static checkers catch errors at compile time without simulating or executing the 
program. A research project based on this strategy, the Extended Static Checker (ESC) has 
been implemented using the technology of program verification. With the ESC, as with static 
checkers generally, the behavioral design has been annotated by a developer so that the 

15 verification condition contains entries associated with specific positions in the source code of 
the program. The ESC represents a compromise between the rigorous demands of complete 
program verification and the limited utility of traditional static checkers. Use of a static 
checker can be important because the cost of a programming error can be greatly reduced if it 
is detected early in the development process. 

20 

Whereas hitherto, static checkers have been successful in pointing out specific source 
locations where errors or potential errors arise, their applicability has been limited in part 
because the designer must still ascertain the path that the program took to the error. 
Accordingly, it is an object of the present invention to cause a static checker to produce 
25 program traces that illustrate the possible run-time conditions (e.g., variable values and 
program execution path) that give rise to the error. 



SUMMARY OF THE INVENTION 

30 

The present invention is a system and method for statically analyzing a specified computer 
program. A verification condition generator converts the program into a logical equation 
called a verification condition, and inserts program flow control labels into sub-equations of 
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the verification condition. The flow control labels identify conditional branch points in the 
specified computer program. In a preferred embodiment, the computer program is converted 
into an intermediate language form before being converted into the logical equation. 

5 In a preferred embodiment, at least one of the flow control labels is of the form {LBLPOS L 
P} or {LBLPOS L True} => P wherein L is a flow control label name. In another 
embodiment, at least one of the flow control labels is of the form L => P or is of the form 
L =k => P wherein L is a flow control label name, k is a constant value and P is a 
subcomponent of the verification condition. In a further preferred embodiment, the flow 
10 control label name comprises a string that identifies the type of branch in the program, a line 
number in the specified computer program and, optionally, a column number on the line 
number. 

A theorem prover is applied to the logical equation to determine the truth of the logical 
15 equation, and when the truth of the logical equation cannot be proved, the theorem prover 
generates at least one counter-example identifying a verification sub-condition (which 
corresponds to a desired program behavior), one or more variable values inconsistent with the 
verification sub-condition, and any of the flow control labels for conditional branch points of 
the program that direct the program to produce the identified variable values. 



A post processing module converts each counter-example into an error message that includes 
a program trace when the counter-example identifies one or more of the flow control labels. 



Additional objects and features of the invention will be more readily apparent from the 
following detailed description and appended claims when taken in conjunction with the 
drawings, in which: 

30 Fig. 1 is a block diagram a of a programmed general purpose computer according to an 
embodiment of the Verification Condition Static Checking system; 



20 



BRIEF DESCRIPTION OF THE DRAWINGS 



25 
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Fig. 2 is a flow chart showing the application of a verification condition static checking 
module to an annotated computer program. 

Fig.3 is a flow chart showing the insertion of flow control labels into a computer program as 
5 part of the process of generating a verification condition for the computer program. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

10 Referring to Fig. 1, the present invention may be implemented using a programmed general- 
purpose computer system 100. The computer system 100 includes: (a) one or more data 
processing units (CPU's) 102; (b) memory 106, which will typically include both high speed 
random access memory as well as non-volatile memory (such as one or more magnetic disk 
drives); (c) a user interface 108; (d) a network or other communication interface 1 10 for 

15 communicating with other computers as well as other devices; and (e) one or more 

communication busses 104 for interconnecting the CPU(s) 102, memory 106, user interface 
108, and network interface 1 10. 

The computer system's memory 106 stores procedures and data, typically including: 
20 • an operating system 1 12 for providing basic system services; 

application programs 1 14, such as user level programs for viewing and manipulating 
images; 

authoring tools 116, for assisting with the writing of computer programs; and 
an annotated computer program 118, representing a computer program to be analyzed 
25 by a verification condition static checking system 120. 

The verification condition static checking system 120 preferably includes: 

a verification condition generator 122, which generates as its output a verification 
condition 124; 

30 a theorem prover 126 that analyzes the verification condition and generates one or 

more counter-examples 128 when it is unable to prove the verification condition; and 
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an analysis module 130 that performs post processing on the counter-examples 
generated by the theorem prover 126, and when an error or potential error in the computer 
program 1 18 is detected, produces one or more error messages 132. 

5 The present invention has been implemented for the language Java in a research project at 
Compaq called ESC/Java. See, for example, Leino, K. R. M., et ai, "ESC/Java User's 
Manual", SRC Technical Note 2000-002, Compaq Computer Corporation Systems Research 
Center, October 2000, also available at http://gatekeeper.dec.com/pub/DEC/SRC/technical- 
notes/SRC-2000-002.html. 

10 

ESC/Java performs modular checking: it can be used to check selected modules of a program 
without checking the entire program. This aspect facilitates use of ESC/Java with programs 
that rely on libraries. ESC/Java also permits checking for selected classes of errors: for 
example it is possible to check for deadlocks and race conditions without checking for array 
1 5 index bounds errors. 

The present invention is used much in the same way as a type checker or like the C tool lint 
so that its warnings are of greatest meaning to the author of the program being checked. 

20 Overview of the Method of the Present Invention 

The operation of a preferred embodiment of the present invention is described with reference 
to Fig. 2. The annotated program 1 18, or behavioral design, to be checked is first processed 
by the verification condition generator 122. For a description concerning verification 
condition generation see K. Rustan M. Leino, "Ecstatic: An object-oriented programming 

25 language with an axiomatic semantics," Proceedings of the Fourth International Workshop on 
Foundations of Object-Oriented Languages, January 1997; and K. Rustan M. Leino, James B. 
Saxe, and Raymie Stata, "Checking Java programs via guarded commands," Technical Note 
1999-002, Compaq Systems Research Center, Palo Alto, CA, May 1999. 

30 The program annotations in the input program or design are supplied by the program 

developer or by an automatic annotation assistant, or both. VC annotations used with the 
present invention are described subsequently, and are distinct from program annotations. 



9772-0274-999, Compaq PD99-2804 



-6- 



CAl - 235669.4 




The verification condition generator 122 first converts the annotated program 1 18 to an 
intermediate programming language that facilitates analysis of the program, and then 
performs a second conversion to generate a "logical equation" that represents the verification 
condition (VC) 124 for the program. In a preferred embodiment, the intermediate 
5 programming language is a version of Dijkstra's guarded commands (Dijkstra, E. W., A 

Discipline of Programming, Prentice-Hall, (1976); see also, Nelson, G., "A Generalization of 
Dijkstra's Calculus", ACM Transactions on Programming Languages and Systems, 
1 1(4):517-61, April 1989). The weakest precondition equations of Dijkstra are used to 
generate the VC. Alternate embodiments can utilize other logical rules, such as Hoare logic, 
10 to generate the VC (see Hoare, "An axiomatic basis for computer programming," 

Communications of the ACM, vol. 12, no. 10, pp.576-580, 583, Oct. 1969). It is within the 
scope of the present invention for the VC generator to convert the annotated program to the 
logical equation without using an intermediate programming language. 

15 An important function of the VC generator 122 is to insert flow control labels into the 

translated form of the program, as will be discussed in more detail below. The verification 
condition includes embedded flow control labels, which are implemented in a preferred 
embodiment as the LBLPOS and LBLNEG labels discussed below and shown in Tables 7 
and 9. The logical equation that is the verification condition is typically a long list of logical 

20 sub-equations. Various subsets and combinations of the sub-conditions must be conclusively 
proved to be true for all possible program conditions. For example, a VC may be expressed 
as S A T A £/, where each of S, T and U is a sub-condition and A is the logical AND operator. 
Each of S, Tand U comes separately from some component of the annotated program or its 
translated form. Each of 5, Tand U must separately be true in order for the VC to hold. 

25 

In another embodiment of the present invention, the VC is the starting point, that is, the 
invention need not go through the step of creating the VC, but instead inserts flow control 
labels directly into the VC. 

30 The theorem prover is refutation-based: to prove a verification condition VC, the prover 

attempts to satisfy ^VC, where -» is the logical negation operator, by finding sets of program 
conditions that cause VC to be false. Accordingly, the job of the theorem prover 126 is to 
symbolically evaluate the sub-equations of the verification condition, for all possible program 
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conditions, to determine which ones (if any) it cannot conclusively prove to be true. In 
program verification, the failure to satisfy --VC implies that the verification condition is valid 
and the program meets its specifications. Under these circumstances, as the theorem prover 
is unable to refute the verification condition, it exits and provides the user with a conclusion 
5 134. Such an outcome does not necessarily mean that the program is entirely correct, it only 
implies that no errors in specified categories have been found. Other categories of errors are 
the programmer's responsibility. On the other hand, failure to prove any sub-equation to 
always be true means that one or more of the pre-conditions or post-conditions required for 
proper operation of the program is not satisfied, or may potentially not be satisfied (if the 
10 theorem prover is not able to prove the truth of a sub-equation, even though it is in fact true). 

In the method of the present invention, because the program is being checked for a prescribed 
set of properties, the satisfaction of ^VC gives an error context for the original program. 
Accordingly, for each sub-equation whose truth cannot be proved and which is marked with a 
15 condition label, the theorem prover generates one or more counter-examples 128. A counter- 
example is typically a set of variable values that violates a specified one of the conditions 
required for proper operation of the program. Thus, a counter-example must identify the 
instruction or instruction element associated with a condition, the condition itself, and the set 
of variable values that cause the condition to be not true. 

20 

When using the present invention, a counter-example may also include one or more flow 
control labels, which identify a path through the program that produces the variable values 
and error in the counter-example. In some circumstances, a counter-example may not include 
any flow control labels because all program paths can result in the variable values in the 
25 counter-example. 

The counter-examples are passed to an analysis module 130, also called the post processor, 
which converts the counter-examples into error messages 132, including program trace 
information that identifies the path through the program required to produce the variable 
30 values in the counter-example. Typically, the variables in the counter-example are given 
names that are uniquely indicative of their location in the source. Such names facilitate 
analysis by the post-processor module 130. The post-processor 130 is preferably a parse- 
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engine that recognizes flow control labels within the VC and extracts relationships between 
them. 

VC Annotations (flow control labels) used by the Present Invention 
5 The present invention generates a VC such that the post-processing of counter-examples 
obtained by attempting to refute the VC can produce informative warning messages. To be 
informative, the warning messages must be as specific as possible. The ability to identify a 
location in the source where an error arises is well known in the art, but the error messages 
produced are not as informative as one might wish because they do not reveal the path that 
10 the program would take to encounter the error. 

Accordingly, the method of the present invention inserts information into the VC that does 
not change the validity of the VC, but is such that the presence or absence of parts of this 
information in a counter-example provides sufficient data from which to reconstruct one or 
15 more execution or program traces that may violate desirable properties. An execution trace 
of this sort is not one that is produced as the program runs, rather it is one that is deduced 
from the information presented in the counter-example. 

The information in the VC that permits reconstruction of an execution trace may be 
20 introduced in a number of different ways. The information may derive from annotations, 
such as flow control labels, inserted into the behavioral design or computer program 118, 
from annotations introduced into the guarded command form of the program or from 
annotations put directly into the VC itself. 

25 In a preferred embodiment, in order to use the execution tracing feature of the verification 
condition static checking module 120, the program to be analyzed is typically annotated to 
indicate program specific pre-conditions and post-conditions that are to be verified. 
Examples of such conditions are provided below. Other conditions that are not program 
specific, such as making sure that no instruction "dereferences" a null pointer and that no 

30 instruction accesses an array element outside the array's boundaries, may be automatically 

checked by the module 120, even without annotation of the program. Such automatic checks 
are often found within static checkers of the prior art and can typically be overridden with 
specific annotations. Providing annotations to override automatic checks is useful, for 
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instance, when the verifier module generates an spurious warning message for a particular 
instruction or program element. 

To implement the invention, as shown in Figure 3, a "name" or label is associated with each 
subcomponent of the design to which a verification condition applies. A subcomponent is an 
instruction or a portion of an instruction. In particular, subcomponents that control the 
execution of an annotated program 118, such as conditional branch points, are identified, step 
136. Flow control labels are inserted into the program, step 138 and persist when and if the 
program is converted to an intermediate language, step 140. Alternately, steps 136 and 138 
are performed while converting the program into an intermediate language. A verification 
condition is then generated from the annotated program, step 142. 

Ultimately, the aforementioned flow control labels are attached to the verification condition 
so that they will appear in the counter-example context whenever information about the 
instructions appears in the counter-example. In general, the VC has a structure that 
corresponds to the structure of the program. Examples of label names and the way in which 
they are used are given below. 

A label name "L" can be attached to a portion "P" of a verification condition in one of a 
variety of ways. Four exemplary cases in which labels can be applied are as follows: 

1. L ==> P 

2 . L = k ==> P 

3 . (LBLPOS L P) 

4. (LBLPOS L true) ==> P 

where: in the first case "L" is used as a predicate symbol; in case 2, "L" is used as the name 
of a variable and "k" is some constant or "L" itself; and in cases 3 and 4, "L" is used as a 
label. Logical equivalents of cases 3 and 4, using the LBLNEG construct, are: -{LBLNEG L 
-^P), and -^P => (LBLNEG L false). Cases 1 and 2 work with most theorem provers that 
handle first-order predicate logic, whereas the labels "LBLNEG", and "LBLPOS" work only 
with provers that feature a mechanism by which a subexpression in the input can be labeled. 
(For instance, such labels are supported in Compaq's Simplify theorem prover, discussed at 
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http://www.researchxompaqxom/SRC/esc/Esc.html). The four cases are now discussed in 
further detail. It is noted here that many of the explanations provided within the separate 
discussions of the four cases are applicable to all four cases. 

5 Casel: L=>P 

The first case can be described with reference to an exemplary program control structure, 
represented in pseudo-code as follows: 

{If (Q) {A} else {B}}; C 
To find whether this portion of code is always correct, the corresponding portion of the VC is 
10 the following mathematical formula: 

(q ==> Correct (A; C) ) A ( - Q ==> Correct (B; C) ) 
where the implies (=>) operator has been used. The interpretation of this formula is: if Q 
holds, then A followed by C must both also be correct; but if Q does not hold, then B 
followed by C must both be correct. The formula can be simply represented as P A R 
15 wherein P and R represent, respectively, the first and second subcomponents. 

When the VC is tackled by the theorem prover, it is desirable to know whether a particular 
counter-example is associated with a particular branch in a control structure such as that 
shown above. Accordingly, names associated with subcomponents of the control structure 
20 are caused to appear within the counter-examples. By attaching a name, L, with 

subcomponent P of the formula, the subcomponent can itself be replaced by an expression of 
the form L => P in the VC. For this device to work, L must be a predicate whose name has 
not been used elsewhere within the VC. For some theorem provers, it may be necessary to 
declare that L is a predicate. L can also be thought of as a boolean variable. 

25 

In order to find a counter-example, the theorem prover tests for failures of the subcomponent 
L => P. For this purpose, it is instructive to consider the truth table for the "implies" 
operator. The only circumstance under which L => P is false is when L is true and P is 
false, i.e., LA -1 P. (The situation where L is false implies nothing at all about P.) For the 
30 theorem prover to construct a counter-example, that counter-example must contain L = True. 
Accordingly, the theorem prover attempts to refute the VC by inventing assignments to 
predicates and variables so that L is found to be true, but P is false and, hence, the entire VC 
is false. The theorem prover is not constrained by the values it can assign to L because L is a 
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fresh variable. Furthermore, any counter-example now produced by the theorem prover 
includes L. 

In accordance with the present invention, at least one label L inserted in a program is a flow 
5 control label and is associated with a particular conditional branch direction (e.g., the 

"THEN" or "ELSE" branch of an IF statement). The inclusion of the label L in the counter- 
example allows the user to determine the execution path of the program associated with the 
counter-example because the presence of the label in the counter-example indicates which 
branch direction was taken to arrive at the program state that violates a sub-condition of the 
1 0 VC for the program. 

Case 2: L = k => P 

In the second case, L is not a predicate but takes the role of a term and k is a constant. For 
example, L may be an integer variable and k may be a particular integer value, such as 1 7. 
15 Thus, in a similar manner to the above, a subcomponent of the formula can also be replaced 
by an expression of the form L = k => P in the VC. The reason for distinguishing the type 
of L in the first and second cases is that some theorem provers do not permit arbitrary names 
to be assigned to predicates, so L must be an integer variable. In general, a theorem prover 
may act differently on a predicate than on an integer variable. 

20 

As with the previous case, when the theorem prover finds a counter-example, it is such that 
the left hand side of the implies statement is true and the right hand side is false. In the above 
example, the left hand side of the implies statement is true if L = 17. Accordingly, if the 
theorem prover finds a counter-example, within that counter example it can be found that L = 
25 17. 

Ideally, a mechanism should be employed to prevent the theorem prover from producing 
counter-examples in which conditions such as L = 1 7 (or L=True for Case 1 , above) are 
printed but where such conditions are irrelevant. For example, when the theorem prover is 
30 working on an expression R that has not been labeled with L, if a situation is found in which 
R is false, then this situation holds whatever the value of L. If the theorem prover printed out 
L = 17 in these circumstances, the output would be confusing. Accordingly, appropriate 
heuristic mechanisms are employed to ensure that labels such as L are only printed out when 
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applicable to the subcomponents in question. In particular, these heuristic mechanisms 
prevent the label L from being included in a counter-example when the truth or falsity of the 
sub-condition associated with the label is not relevant to the counter-example. Stated another 
way, if the part of the VC where the label is located is the part which the theorem prover has 
5 been unable to prove, then the label will normally be included in the counter-example. 

The first and second cases therefore show how a label associated with a particular 
subcomponent of a program can be caused to be included in a verification condition. An 
alternate embodiment can be envisaged in which L is assigned to a string variable instead of a 
1 0 boolean or an integer variable. 

Case 3: LBLNEG and LBLPOS 

Logically, a statement such as L => P is equivalent to - 1 L V P. Because of this equivalence, 
a theorem prover normally has to consider two possible routes through the program 

15 separately. Where there are many such branches, the situation can become complex. For 

example, n branches leads to 2" possible routes. In this context, the LBLPOS and LBLNEG 
constructs can both be utilized in flow control labels within the VC so that program or 
execution trace information can be revealed. When the VC contains flow control labels in 
subexpressions of the VC, using the LBLPOS and LBLNEG constructs, the counter- 

20 examples produced by the theorem prover also contain flow control labels. The LBLPOS and 
LBLNEG constructs can be wielded in a number of different ways, depending upon context. 

In order to generate program trace information, a flow control label is inserted into 
conditional branch instructions in the program by the verification condition generator. Only 
25 conditional branch points of the program need to be labeled with flow control labels. This is 
because the sequence of branches that a program takes is the information needed to follow the 
sequence of events in a counter-example that illustrates an error or potential error condition. 
However, it may be helpful to label additional program statements as well to produce more 
complete program flow information and thus easier to understand counter-examples. 

30 

In general, a LBLPOS flow control label is included in the output produced by the theorem 
prover if the condition associated with the label is true in and relevant to the counter- 
example. A LBLNEG flow control label is included in the output produced by the theorem 
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prover if the condition associated with the label is false in and relevant to the counter- 
example. 

The context of each LBLNEG or LBLPOS -flow control label has the form {LBLNEG label 
condition} or {LBLPOS label condition} . In a preferred embodiment, the "label" identifies 
the line number of the instruction and the line position of the instruction operand or operator 
such as "then" or "else" that is the subject of the program condition, and the "condition" 
specifies the program condition to be applied and the variable or other instruction element to 
which it is to be applied or can be "true" or "false". 

By way of illustration, if 
(LBLNEG K Q) 

is inserted into the verification condition, where K is a label and Q is a condition within the 
verification condition, if condition Q is included in the counter-example produced by the 
theorem prover and is false {i.e., negative), the label K is included in the representation of the 
counter-example. 

Next, let us consider a condition P of a verification condition that is annotated using the label 
"LBLPOS L", 

(LBLPOS L P). 

where P can be true or false, depending upon context. If P is a predicate or other part of a 
counter-example produced by the theorem prover and true {i.e., is positive), the label L is 
included in the representation of the counter-example. 

A further illustration of LBLPOS is as follows: 
(LBLPOS L True) 

In this case, the condition P is replaced by True. Since True can always be made to be a part 
of any counter-example, label L would theoretically be produced with every counter- 
example, a result that would not be particularly useful Instead, heuristics are used so that L 
is only produced where condition P is in the part of the VC identified by the theorem prover 
as potentially containing an error. 
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It is noted that a logical equivalent of (LBLPOS L P) is -(LBLNEG L -P). Uses of the 
LBLNEG and LBLPOS constructs are further illustrated and described in the Example, 
below. 

5 Case 4: (LBLPOS L true) = = > P 

A further use of LBLPOS and LBLNEG is mathematically equivalent to the previous case. 
In general, the best way to attach a name to a portion of a verification condition may depend 
on the particular theorem prover used, and is not limited to the four examples given above. 

10 In one embodiment of the present invention, flow control labels are assigned to a program 
prior to converting the annotated program to guarded command form. In another 
embodiment, flow control labels are assigned while converting the annotated program to 
guarded command form. 

15 Ultimately, the LBLNEG and LBLPOS constructs serve as flags to alert the theorem prover 
that what immediately follows is a label name. In a preferred embodiment, each label name 
indicates the position in the source program of the subcomponent to which the label applies. 
In one embodiment, all labels begin with "trace.", for ease of recognition. A further 
component of the label name can be "then" to denote that an IF branch of a choice control 

20 structure was taken, or "else" to denote that an ELSE branch was taken. A label name can 
also optionally contain one or more separators such as " A ". In a preferred embodiment, a 
label name contains a line and column number and, for example, a sequence number 
indicating the order of execution of the program statements that have been labeled. When a 
program contains a loop, which may be "unfolded" more than once while generating the VC, 

25 or contains a subprocedure that has been inlined more than once, the sequence number in the 
label name enables the user (typically a programmer) to determine which occurrence of the 
program statement is implicated in the error condition. An example of a label name is 
"trace.Else A 2,8.11" wherein the Else instruction is found at column 1 1 of line 8 of the 
annotated program and is the third instruction in the program to have a flow control label. An 

30 - alternative naming scheme can be envisaged in which labels L are assigned a characteristic 
set of characters, e.g., "XX" followed by a number, in sequence, e.g., 1708. An 
accompanying table serves to correlate the variable names with their respective positions in 
the annotated program. 
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In a preferred embodiment, when presenting a counter example, the label names of statements 
implicated in the error condition are presented in the order dictated by their sequence 
numbers ("sequence number order"). 

5 Names appearing in a counter-example are extracted by the post-processor 130. In turning 
these extracted names into a program trace for the warning message, the post-processor uses 
the recorded association between the name and the subcomponent of the design. For 
applications of the invention where the actions or steps in execution traces are ordered, the 
order of the associated subcomponents can be used to sort the reconstructed parts of the 
10 execution trace. 

EXAMPLE 

Operation of a Preferred Embodiment 

15 Operation of a preferred embodiment of the present invention will be explained through an 
example, shown here in Tables 1 through 13. 

Table 1 shows an example of a Java program that is to be checked by the verification 
condition static checking module 120 (program verifier). 



An example Java program, T.java used as input to the Verification Condition Static Checking 
Module. Line numbers are shown at the left hand side, beginning at line 1 , and column 



20 



Table 1 



numbers, beginning at column 0, in groups of 10 are shown at the top. 



25 



0123456789012 3456789012 3456789012 34567890 



1 
2 
3 
4 
5 
6 
7 
8 
9 

10 
11 



class T { 

static int x; 



30 



static void m(int[] a, int [] b) { 
int[] c; 

if (a != null) { 
c = a; 



35 



} else { 
c = b; 



} 

x = c. length; 
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10 



15 



12 } 

13 } 



In the Java program illustrated in Table 1, line 1 1 can only execute if c is not null. 
Accordingly, an appropriate check for the theorem prover is to establish whether c could ever 
be null and to produce a counter-example with a program or execution trace that shows how 
line 1 1 could be caused to execute with c null. 

It can be seen that variable c is assigned in lines 1 1 and 13, in both branches of an 
if., .then.. .else control structure. Execution of one of these branches gives rise to a potential 
error at line 11. It is an object of the present invention to show which of those branches is 
responsible. 

Tables 2-6 represent an example of the operation of a program verifier that does not use the 
present invention. The operation of such a program will be contrasted with the operation of 
the present invention, as shown in Tables 7-13. 

20 Table 2 shows the output generated by a program verifier module that does not utilize the 
present invention. A potential null dereferencing error is identified, but the error message 
does not provide an execution trace to indicate how the object reference "c. length" could 
have a null value. 

Table 2 

25 Output from prior art program verifier when applied to the program of Table 1 

T.java:ll: Warning: Possible null dereference (Null) 
x = c. length ; 

1 warning 



30 



35 

The program verifier first produces an intermediate language representation of the program. 
In this example, the intermediate representation is in guarded command language, shown in 
Table 3. 
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Table 3 

An intermediate-language program produced from the Program in Table 1, 
without applying the present invention 



1 ASSUME boolAnd ( is (a : 4 . 22 , type ( int [] ) ) , isAllocated (a : 4 . 22 , alloc)); 
5 2 ASSUME boolAnd (is (b : 4 . 31, type ( int [])) , isAllocated (b : 4 . 3 1 , alloc)); 

3 VAR int[] a@pre:4.22; int [] b@pre:4.31 IN 

4 a@pre:4.22 = a : 4.22; 

5 b@pre:4.31 = b:4.31; 

6 { VAR int[] C:5.10 IN 

10 7 { ASSUME refNE{a:4 .22, null); 

8 C : 5 . 10 = a: 4 . 22 

9 [] 

10 ASSUME boolNot (refNE(a:4 .22, null)); 

11 c:5.10 = b:4.31 
15 12 }; 

13 ASSERT (LBLNEG Null@ll . 9 ref NE (c : 5 . 10 , null)); 

14 x:2.13 = arrayLength (c : 5 . 10) 

15 END; 

16 EC = ecReturn 
20 17 ! SKIP 

18 }; 

19 RESTORE a: 4. 22 FROM a@pre:4.22; 

2 0 RESTORE b:4.31 FROM b@pre:4.31 
2 1 END ; 

25 22 ASSERT (LBLNEG Except ion : 4 . 14@12 . 2 anyEQ(EC, ecReturn)) 



For every proof obligation, an ASSERT statement is introduced into the intermediate 
30 language form. The ASSERT statement also eventually makes it into the VC 

The ASSERT statement at line 13 of Table 3 denotes a condition that needs to be proved, i.e., 
must hold for the program to correctly execute. Such an assert is ordinarily automatically 
inserted for any dereference operation. The use of LBLNEG here is so that the theorem 

35 prover will report the label if the condition that follows is false in the counter-example. 
(Thus this use of the LBLNEG construct is not as part of a flow control label.) The term 
"Null@l 1 .9" in the same line denotes a check for a null dereference at line 1 1 , column 9 of 
the original program. The '@' symbol is used in labels as a symbol that the post-processor 
can find easily. A notation like this makes it easier for the theorem prover to parse the 

40 guarded command form and identify potential problems for illustration in the counter- 
examples. In Table 3, the term "refNE" means reference not equal. In line 13 of Table 3, the 
refNE operator refers to variable c and null. Variable c is identified as "c:5.10" to denote that 
it is the variable that is declared at line 5, column 10 of the original program in Table 1. 
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The guarded command representation is, in turn, converted into the logical equation, called 
the verification condition, shown in Table 4. The verification condition includes many sub- 
equations. When any of these sub-equations can be evaluated to a value that causes the 
verification condition to be false, that situation represents an error or potential error (or a 
5 failure or weakness of the theorem prover). Each such sub-equation is identified as a counter- 
example, an example of which is shown in Table 5. 

Table 4 

The verification condition produced from the intermediate-language program of Table 3. 

10 1 (IMPLIES 

2 • (AND (DISTINCT | ecReturn | ) ) 

3 (LBLNEG 

4 | vc . T . m - 4 . 2 | 

5 (IMPLIES 
15 6 (AND 

7 (EQ |x@pre:2.13| |x:2.13|) 

8 (EQ | ©true | (is |x:2.13| | T_int | ) ) 

9 (EQ |elems@pre| elems) 

10 (EQ elems (asElems elems) ) 

20 11 (< (eClosedTime elems) alloc) 

12 (EQ LS (asLockSet LS) ) 

13 (EQ |alloc@pre| alloc) ^ 

14 (EQ j ©true | (is |a:4.22| (array | T_int | ) ) ) 

15 (EQ | ©true j (isAllocated |a:4.22| alloc)) 
25 16 (EQ | ©true j (is |b:4.3l| (array j T_int | ) ) ) 

17 (EQ | ©true | (isAllocated |b:4.3l| alloc))) 

18 (FORALL 

19 ( |a@pre:4.22 | |b@pre:4.3l| |c:5.10|) 

20 (AND 

30 21 (IMPLIES 

22 (NEQ |a:4.22| null) 

23 (AND 

24 (LBLNEG |Null@11.9| (NEQ |a:4.22| null)) 
2 5 (FORALL 

35 26 (|x:11.4|) 

2 7 (IMPLIES 

28 (EQ |x:11.4| (arrayLength |a:4.22|)) 

2 9 (LBLNEG | Except ion : 4 . 14@12 . 2 | (EQ | ecReturn | | ecReturn | 

)))))) 

40 3 0 (IMPLIES 

31 (NOT (NEQ |a:4.22| null)) 

32 (AND 

33 (LBLNEG |Null@11.9| (NEQ |b:4.3l| null)) 

3 4 (FORALL 

45 35 (|x:11.4|) 

36 (IMPLIES 

37 (EQ |x:11.4| (arrayLength |b:4.3l|)) 

38 (LBLNEG | Except ion : 4 . 14@12 . 2 | (EQ | ecReturn | 

| ecReturn | ) )))))))))) 

50 
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In Table 4, the occurrence of the potential null dereference at line 11, column 9 of the original 
annotated program is indicated by the LBLNEG in two places, lines 24 and 33. Each of these 
two places corresponds to one of the two possible branches in the original program. The 
difficulty is that neither of these labels, when included in the counter-example output 
5 produced by the theorem prover, gives an indication of how the program progressed prior to 
encountering the error condition. 



Table 5 

Output of Theorem Prover 

10 (based on input of Table 4 and the context axioms associated with the program of Table 1) 

Counter-example labels ( | vc . T . m . 4 . 2 | |Null@11.9|) 
counter-example context 
(AND 
TRUE 

15 (<= |x:2.13| intLast) 

(<= intFirst |x:2 . 13 | ) 

(< (eClosedTime | elems@pre | ) | alloc@pre | ) 

(EQ |a:4.22| null) 
20 (EQ |b:4.3l| null) 

(EQ |elems@pre| elems) 

(EQ |x@pre:2.13| |x:2.13|) 

(NEQ |bool$false| |@true|) 

) 

25 . — 

It is from this counter-example (in particular, the labels shown in the first line of the counter- 
example) that the program verifier produces the error message shown in Table 2. Table 5 
purposefully omits some portions of the counter-example context that are not relevant to this 
30 explanation. 



By contrast, Tables 6, 7, 9, and 1 1 represent an example of the operation of a program verifier 
that uses the present invention. 



35 Table 6 shows the output generated by a program verifier module that utilizes the present 

invention. A potential null dereferencing error is identified, along with a program trace that 
indicates how the object reference "c.length" could have a null value. 
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Table 6 

Output from the Program Verifier of the present invention 
(based on program of Table 1, applying the present invention) 

5 

T.java:ll: Warning: Possible null dereference (Null) 
x = c. length; 

Execution trace information: 
10 Executed else branch in "T.java" , line 8, col 11. 

1 warning 



1 5 The program verifier of the present invention produces an intermediate language 
representation of the program, shown in Table 7. 

Table 7 

The intermediate-language program produced from the program in Table 1 by the 



20 verification condition generator, applying the present invention. 





i 


ASSUME boolAnd (is (a :4 . 22 , type ( int [] ) ) , isAllocated (a : 4 


.22 , 


alloc) ) ; 




2 


ASSUME boolAnd (is (b :4 . 31, type (int [])) , isAllocated (b : 4 


.31, 


alloc) ) ; 




3 


VAR int[] a@pre:4.22; int [] b@pre:4.31 IN 








4 


a@pre : 4 . 


22 = a:4.22; 






25 


5 


b@pre : 4 . 


31 = b : 4 . 3 1 ; 








6 


{ VAR int [] c : 5 . 10 IN 








7 


{ 


ASSUME refNE(a:4.22, null); 








8 




ASSUME (LBLPOS trace . Then" 0 , 6 . 19 true); 








9 




C : 5 . 10 = a : 4 . 22 






30 


10 


[] 










11 




ASSUME boolNot (refNE (a :4 . 2 2 , null)); 








12 




ASSUME (LBLPOS trace . Else" 1 , 8 . 11 true) ; 








13 




c:5.10 = b:4.31 








14 


}; 








35 


15 


ASSERT (LBLNEG Null@11.9 ref NE (c : 5 . 10 , null)); 








16 


X : 


2.13 = arrayLength (c : 5 . 10) 








17 


END; 










18 


EC = 


ecReturn 








19 


! SKIP 








40 


20 


}; 










21 


RESTORE 


a: 4. 22 FROM a@pre:4.22; 








22 


RESTORE 


b:4.31 FROM b@pre:4.31 








23 


END; 










24 


ASSERT (LBLNEG Except ion : 4 . 14@12 . 2 anyEQ(EC, ecReturn) ) 






45 













Table 7 again uses the guarded command form. Note that this time, in contrast to Table 3, 
the intermediate language representation of the program includes flow control labels that 
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identify the line and position of the "then" and "else" instruction elements in the program as 
can be seen at lines 8 and 12 of Table 7 where LBLPOS flow control labels are printed. Note 
that the names of the labels include line and column numbers that represent the positions in 
the program at which they apply. The way in which LBLPOS flow control labels have been 
5 used in this example is that of Case 4, discussed above. The format of the flow control labels 
in this example is {LBLPOS Label True} . The names of the labels are respectively 
characteristic of the "then" and "else" branch. 

Table 8 shows the differences between the two intermediate language representations of 
10 Tables 3 and 7 to highlight the difference between the verification system of the prior art and 
the present invention. The version of the verifier module that utilizes the present invention 
inserts flow control labels in lines 8 and 12 of the intermediate language representation. 



Table 8 



15 



The differences between Tables 3 and 7 



The following two lines of Table 7 are not present in Table 3: 



Line 8: 



ASSUME (LBLPOS trace . Then^ 0 , 6 . 1 9 true); 



20 



Line 12: 



ASSUME (LBLPOS trace . Else*" 1 , 8 . 1 1 true) ; 



There are no other differences. 



25 



The intermediate language representation of the program is converted into the logical 
equation, called the verification condition, shown in Table 9. 



30 
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Table 9 

The verification condition produced from the intermediate-language program of Table 7 



1 { IMPLIES 

5 2 (AND (DISTINCT |ecReturn|)) 

3 ( LBLNEG 

4 | vc . T . m . 4 . 2 | 

5 (IMPLIES 

6 (AND 

10 7 (EQ |x@pre:2.13| |x:2.13|) 

8 (EQ j ©true | (is |x:2.13| | T_int | ) ) 

9 (EQ |elems@pre| elems) 

10 (EQ elems (asElems elems) ) 

11 (< (eClosedTime elems) alloc) 
15 12 (EQ LS (asLockSet LS) ) 

13 (EQ |alloc@pre| alloc) 

14 (EQ [©true | (is |a:4.22| (array | T_int | ) ) ) 

15 (EQ [ ©true | (isAllocated |a:4.22| alloc)) 

16 (EQ | ©true j (is |b:4.3l| (array | T_int | ) ) ) 
20 17 (EQ | ©true j (isAllocated |b:4.3l| alloc))) 

18 (FORALL 

19 ( |a@pre:4 .22 | |b@pre:4.3l| |c:5.10|) 

20 (AND 

21 (IMPLIES 

25 22 (AND (NEQ |a:4.22| null) (LBLPOS | trace . Then" 0 , 6 . 19 | TRUE)) 

23 (AND (LBLNEG |Null@11.9| (NEQ |a:4.22| null)) 

24 (FORALL 

25 (|x:11.4|) 

26 (IMPLIES 

30 2 7 (EQ |x:11.4| (arrayLength |a:4.22|)) 

2 8 (LBLNEG | Except ion : 4 . 14@12 . 2 | (EQ jecReturn| | ecReturn | ) ) ) ) ) ) 

2 9 (IMPLIES 

30 (AND (NOT (NEQ |a:4.22| null)) (LBLPOS | trace . El se" 1 , 8 . 11 | TRUE) ) 

31 (AND (LBLNEG |Null@11.9| (NEQ |b:4.3l| null)) 
35 3 2 (FORALL 

33 (|x:11.4|) 

34 (IMPLIES 

3 5 (EQ | x: 11. 4 | (arrayLength |b:4.3l|)) 

3 6 (LBLNEG | Except ion : 4 . 14@12 . 2 | (EQ | ecReturn | | ecReturn | 

40 37 ))))))))))) 



This Table shows also the two occurrences of LBLNEG, at lines 23 and 31, corresponding to 
45 the check for a null dereference at line 1 1 of the original program. The two occurrences of 
LBLPOS, corresponding to the "then" and "else" branches of the original program are also 
shown in table 9, at lines 22 and 30, respectively. Both occurrences of LBLPOS are found 
within an IMPLIES context, expressed in table 9 in the 'prefix' notation, i.e., "x=>y" is 
written as (IMPLIES (x)(y)). For example, the literal expression of lines 21-23 is: 
50 ((a * NULL) A ( LBLPOS trace.Then A 0,6. 19 TRUE)) => 

((LBLNEG Null@l 1.9 (a * NULL)) A ... ) 
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Therefore, the verification condition in Table 9 includes expressions that contain both the 
LBLNEG labels for the null-dereferenced variable and the LBLPOS labels that indicate the 
sides of the branches. This verification condition is a precursor to a more informative 
presentation in which the position of the null-dereference is connected explicitly to an 
execution path through the program. 

Table 10 shows the differences between the verification conditions shown in Tables 4 and 9. 
The verification condition generated by the version of the verifier module that utilizes the 
present invention includes flow control labels in lines 22 and 30 of the verification condition. 

Table 10 

The differences between Tables 4 and 9 

Line 22 of Table 4: 
15 (NEQ |a:4.22| null) 

is replaced in Table 9 by line 22: 

(AND (NEQ |a:4.22| null) (LBLPOS |trace.Then A 0,6.19| TRUE)) 

20 

Line 31 of Table 4: 

(NOT (NEQ |a:4.22| null)) 
25 is replaced in Table 9 by line 30: 

(AND (NOT (NEQ |a:4.22| null)) (LBLPOS |trace.Else A 1,8.1 1| TRUE)) 
There are no other differences. 

30 

The verification condition shown in Table 9 includes many sub-equations, two of which are 
labeled with flow control labels. When any of these sub-equations can be evaluated to a 
35 value that causes the verification condition to be false, that represents an error or potential 
error (or a failure or weakness of the theorem prover). Each such sub-equation is identified 
as a counter-example, an example of which is shown in Table 1 1 . 
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Table 1 1 
Theorem Prover Output 
(based on verification condition of Table 9 and the context axioms associated with the 
program of Table 1) 



Counter-example labels ( | vc . T.m. 4 . 2 | | trace . Else^l , 8 . 11 | 

|Null@ll . 9 I ) 

count e r - examp 1 e c on t ext 
(AND 

10 TRUE 

(<= |x:2.13| intLast) 
(<= intFirst |x:2.13|) 

(< (eClosedTime | elems@pre | ) | alloc@pre | ) 

15 (EQ |a:4.22| null) 

(EQ |b:4.3l| null) 
(EQ |elems@pre| elems) 
(EQ |x@pre:2.13| |x:2.13|) 
(NEQ | bool $ f al se | | ©true | ) 

20 ) 



It is from this counter-example (in particular, the labels shown in the first line of the counter- 
25 example) that the program verifier produces the error message shown in Table 6. So, here, 
the label "trace.Else A l,8.11" indicates that an execution trace is contemplated and that a 
branch point encountered prior to the potential error was the "else" branch of line 8. The 
label "Null@l 1.9" describes the source of the error as being a null dereference at line 11, 
column 9. 

30 

Table 1 1 does not include some portions of the counter-example context that are not relevant 
to this explanation. 

Tables 12 and 13 contain simplified versions of Tables 7 and 9, respectively, that make it 
35 easier to see the relationship between the portions of the program in which flow control 

statements have been inserted and the corresponding portions of the verification condition. 
Lines 5 and 9 of Table 12, which contain flow control labels (LBLPOS), are the ones 
introduced by the present invention. 
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30 



35 



40 



Table 12 
Simplified Version of Table 7 



1 ASSUME ±3(3:4.22, type ( int [ ] ) ) ; 

2 ASSUME is(b:4.31 / type ( int [])) ; 
5 3 VAR int[] c:5.10 IN 

4 { ASSUME refNE (a : 4 . 22 , null); 

5 ASSUME (LBLPOS trace . Then^ 0 , 6 . 1 9 true) ; 

6 c:5.10 = a:4.22 

7 [] 

10 8 ASSUME boolNot (refNE (a :4 .22, null)); 

9 ASSUME (LBLPOS trace . Else^l , 8 . 11 true); 

10 c : 5 . 10 = b:4 . 31 

11 }; 

12 ASSERT (LBLNEG Null@11.9 ref NE (c : 5 . 10 , null)); 
15 13 x:2.13 = arrayLength (c : 5 . 10) 

14 END 



20 Note that this simplified version of Table 7 shown in Table 12 is only for the purpose of 

explaining Table 7 and draws attention to the parts that are of interest for understanding the 
present invention. 

Table 13 

25 Simplified Version of Table 9 



1 


(LBLNEG 










2 


| vc . T . m . 4 . 2 | 










3 


(IMPLIES 










4 


(AND 










5 


(EQ |@true 


| (is 


|x: 


2 . 


13 | | T_int | ) ) 


6 


(EQ |@true 


| (is 


|a: 


4 . 


2 2 | (array | T_int j ) ) ) 


7 


(EQ |@true 


| (is 


|b: 


4 . 


31 | (array j T_int j ) ) ) ) 


8 


(FORALL 










9 


(|c:5.10|) 










10 


(AND 










11 


(IMPLIES 










12 


(AND (NEQ |a:4 


.22 | 


null) (LBLPOS | trace. Then" 0,6. 19 | TRUE)) 


13 


(LBLNEG 


|Null@ll. 


*l 


(NEQ |a:4.22| null))) 


14 


(IMPLIES 








22 | null)) (LBLPOS | trace . Else A l , 8 . 11 | TRUE)) 


15 


(AND (NOT 


(NEQ 


|a: 


4 - 


16 


(LBLNEG 


| Null@ll . 


9\ 


(NEQ |b:4.3l| null))))))) 



45 Note that Table 13 is a simplified version of Table 9, only for the purpose of explaining Table 
9, drawing attention to the parts that are of interest for understanding the invention. 
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Alternate Embodiments 



The present invention can be implemented as a computer program product that includes a 
computer program mechanism embedded in a computer readable storage medium. For 
instance, the computer program product could contain the program modules shown in Fig. 1 . 
These program modules may be stored on a CD-ROM, magnetic disk storage product, or any 
other computer readable data or program storage product. The software modules in the 
computer program product may also be distributed electronically, via the Internet or 
otherwise, by transmission of a computer data signal (in which the software modules are 
embedded) on a carrier wave. 

While the present invention has been described with reference to a few specific embodiments, 
the description is illustrative of the invention and is not to be construed as limiting the 
invention. Various modifications may occur to those skilled in the art without departing from 
the true spirit and scope of the invention as defined by the appended claims. 
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